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DATA CONVERSION APPARATUS FOR DATA 
COMMUNICATION SYSTEM 

BACKGROUND OF THE INVENTION 

(1) Field of the Invention 

This invention relates to a data conversion apparatus used 
for TV broadcasting systems, and more specifically to a data 
conversion apparatus for converting HTML (Hyper Text 
Markup Language) documents into information of a format 2 q 
suitable for the TV broadcasting systems. 

(2) Description of the Prior Art 

In recent years, the Internet has become a very popular 
system for obtaining or exchanging information. A great 
number of users view information stored in each site called 25 
home page on the WWW (World Wide Web). In doing so, 
users make interactive operations on the home pages using 
a keyboard or a mouse. In particular, users can move a 
pointer using a keyboard or mouse to select "hot spots," 
which results in a jump to another screen. One example of 20 
such interactive operation techniques is Netscape Navigator 
developed by Netscape Communications Corporation. 

Conventional interactive operation techniques have been 
created on the assumption that a pointing device, such as a 
keyboard or mouse, which are peripheral devices of 25 
computers, is used to input instructions, not a remote con- 
troller of a TV set. That means, it is difficult to use such 
remote controllers for the interactive operations required on 
the home pages on the WWW in the Internet. ^ 

SUMMARY OF THE INVENTION 

It is therefore the object of the present invention to 
provide a data conversion apparatus for multimedia data 
which euables interactive operations on home pages dis- 35 
played on the TV screen by using a remote controller of the 
TV set. 

The above object is achieved by a data conversion appa- 
ratus which is used as a data transmitting apparatus in a data 
communication system, where the data communication sys- 40 
tern achieves pseudo interactive communications by using 
one-way communications between the data transmitting 
apparatus and a plurality of data receiving apparatuses, the 
data conversion apparatus including: document storing unit 
for storing a plurality of documents each of which includes 45 
at least a character string and at least a piece of image 
information, where at least one of the character string and 
the piece of image information includes a piece of link 
destination information which specifies another document as 
a Mnk destination; supplementary design storing unit for 50 
storing a list of supplementary designs with serial numbers 
respectively related to the supplementary designs; display 
image element generating unit for reading the character 
string and the piece of image information one at a time from 
the document storing unit and converting the character string 55 
and the piece of image information into respective display 
image elements, where the display image elements are 
bit-mapped graphics; display image generating unit for 
generating a display image which is composed of the display 
image elements, where the display image has a size which 60 
is equivalent to a size of display screens of the plurality of 
data receiving apparatuses; supplementary design adding 
unit for reading a supplementary design corresponding to the 
piece of link destination information specifying the other 
document as the link destination from the supplementary 65 
design storing unit and adding the supplementary design to 
a corresponding display image element in the display image; 
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and display link destination information converting unit for 
converting the piece of link destination information speci- 
fying the other document as the link destination into a piece 
of display link destination information, the piece of display 
link destination information being related to a serial number 
corresponding to the supplementary design added by the 
supplementary design adding unit, where the piece of dis- 
play link destination information specifies, as a link 
destination, another display image which is a display image 
of the other document generated by the display image 
generating unit. 

With such a construction, since the display image ele- 
ments respectively linked to other display images are visu- 
ally emphasized by the supplementary designs, the user can 
easily find and such display image elements on the display 
screen. Also, with the serial numbers attached to the supple- 
mentary designs, the user can specify a desired link- 
destination display image by using, for example, a remote 
controller of a TV set. 

In the above data conversion apparatus, the display image 
element generating unit may include: a conversion table 
storing unit for storing a character size of the character 
string; and a display image element generating unit for 
converting the character string into a display image element 
according to the character size and converting the piece of 
image information into a display image element. 

In the above data conversion apparatus, the conversion 
table storing unit may further store respective starting posi- 
tions in a horizontal direction of the display image elements, 
where the display image generating unit includes: a display 
position calculating unit for reading the starting positions of 
the display image elements and calculating respective dis- 
play positions of the display image elements in the display 
image; and a display image generating unit for generating 
the display image by arranging the display image elements 
in the display image according to the display positions. 

In the data conversion apparatus, the display image gen- 
erating unit generates a plurality of display sub-images from 
the document, where the display link destination informa- 
tion converting unit includes: a display link destination 
information generating unit for generating a plurality sets of 
pieces of display link destination information which respec- 
tively correspond to the plurality of display sub-images 
generated from the document. 

With such a construction, since pairs of a display image 
and a piece of display link destination information are held 
inside the data conversion apparatus, the user can easily 
operate on display screens such as TV screens on which the 
scrolling function cannot be used. 

In the data conversion apparatus, the supplementary 
design storing unit may include: a maximum number storing 
unit for storing a maximum number of the supplementary 
designs in the display image, where the display image 
generating unit further includes: a maximum number judg- 
ing unit for judging whether the number of the supplemen- 
tary designs to be arranged in the display image exceeds the 
maximum number; and a display image dividing unit for, 
when the maximum number judging unit judges that the 
number of the supplementary designs exceeds the maximum 
number, sending an instruction to the display image gener- 
ating unit to divide the display image into the plurality of 
display sub-images so that supplementary designs less than 
the maximum number are added to each of the plurality of 
display sub-images divided from the display image, where 
the display image generating unit generates the plurality of 
display sub-images according to the instruction. 



In the data conversion apparatus, the display link desti- 
nation converting unit may further include: a display link 
destination sub-information generating unit for generating a 
plurality sets of pieces of display link destination sub- 
information which respectively correspond to the plurality 
of display sub-images generated by the display image gen- 
erating unit. 

With such a construction, since the number of display 
image elements linked to other display images in a display 
screen are limited to a certain number, the user can easily 
specify a desired link-destination display image by using, 
for example, a remote controller of a TV set. 

In the data conversion apparatus, the display image gen- 
erating unit may generate the plurality of display sub-images 
so that each of the plurality of display sub-images includes 
display image elements of a same category. 

In the data conversion apparatus, the document may be 
written in HTML, where the display image generating unit 
determines categories of the display image elements from 
tags written in the document. 

With such a construction, display image elements in a 
document in the same category are displayed on the screen 
as a group. This is convenient for the user when switching 
screens. 

The data conversion apparatus may further include: infor- 
mation obtaining unit for obtaining, via a communication 
line, a document written in HTML (Hyper Text Markup 
Language) which includes at least a character string and at 
least a piece of image information; and information writing 
unit for writing the document written in HTML into the 
document storing unit. 

The above data conversion apparatus may further include: 
first storing unit for storing a plurality of video frames 
which, each having an identifier, are the display image and 
the plurality of display sub-images; second storing unit for 
storing a plurality sets of pieces of display link destination 
information which are generated by the display link desti- 
nation information converting unit and are respectively 
related to the plurality of video frames, where each of the 
plurality sets of pieces of display link destination informa- 
tion having the same identifier as the identifier of a corre- 
sponding video frame; and broadcasting unit for cyclically 
transmitting a certain number of video frames in the first 
storing unit and corresponding sets of pieces of display link 
destination information in the second storing unit. 

With such a construction, it is possible for the user to 
perform pseudo interactive communications with one-way 
communications in which data is transmitted from the data 
transmission apparatus. 

1 BRIEF DESCRIPTION OF THE DRAWINGS 

These and other objects, advantages and features of the 
invention will become apparent from the following descrip- 
tion thereof taken in conjunction with the accompanying 
drawings which illustrate a specific embodiment of the 
invention. In the drawings: 

FIG. 1 is a block diagram showing the construction of the 
data communication system of the present invention 
described in the first embodiment; 

FIG. 2 shows an example of the file list stored in the file 
list storing unit in the first embodiment; 

FIG. 3 shows HTML document 301 "Reporthtmr which 
is the first page of a home page provided by a WWW server 
in the first embodiment; 

FIG. 4 shows image information "Weather.gif" which is 
an image displayed on the first page of the home page in the 
first embodiment; 



FIG. 5 shows HTML document "Tokyo-html" which is an 
image displayed on the second page of the home page in the 
first embodiment; 

FIG. 6 shows HTML document "Osaka.htmr which is an 
5 image displayed on the third page of the home page in the 
first embodiment; 

FIG. 7 shows an example of the link information table 
stored in the data conversion table storing unit in the first 
embodiment; 

10 FIG. 8 A shows the display image information in the first 
page of the home page in the first embodiment; 

FIG. 8B shows the audio information in the first page of 
the home page in the first embodiment; 
is FIG. 8C shows the link information in the first page of the 
home page in the first embodiment; 

FIG. 9A shows the display image information in the 
second page of the home page in the first embodiment; 
FIG. 9B shows the link information in the second page of 
20 the home page in the first embodiment; 

FIG. lOAand FIG. 10B show the transmission data which 
is the third page of the home page in the first embodiment; 
FIG. 11A gives a graphic representation of the transmis- 
25 sion method used by the transmitting unit in the first 
embodiment; 

FIG. 11B shows the multiplexed stream which is trans- 
mitted when digital satellite broadcasting is used in the first 
embodiment; 

30 FIG. 12 is a flowchart showing an overview of the 
procedure of the data transmitting apparatus in the first 
embodiment; 

FIG. 13 is a flowchart showing an example information 
obtaining procedure of the information obtaining unit in the 
35 first embodiment; 

FIG. 14 is a flowchart showing an example procedure for 
generating transmission data by the transmission data gen- 
erating unit in the first embodiment; 
^ FIG. 15 is a flowchart showing a detailed example of the 
processing in step S1312 of FIG. 14; 

FIG. 16 shows an example of the cursor design corre- 
spondence table which the control unit in the first embodi- 
ment generates to control the display position of the cursor 
45 design; 

FIG, 17 shows an example of the design information 
stored by the control unit in the first embodiment; 

FIG. 18 shows the display image for the initial screen 
which is displayed by the display unit based on the trans- 
50 mission data shown in FIGS. 8 A to 8C; 

FIG. 19 shows the display image which is the initial 
screen displayed by the display unit for the transmission data 
shown in FIGS. 9A and 9B; 

FIG. 20 shows the display image which is the initial 
55 screen displayed by the display unit for the transmission data 
shown in FIG. 10A and 10B; 

FIG. 21 is a flowchart showing an example procedure for 
display control which is performed by the control unit in the 
first embodiment; 

FIG. 22 shows the construction of the data conversion 
apparatus in the second embodiment of the present inven- 
tion; 

FIG. 23 shows an example document stored in the infor- 
ms mation obtaining unit in the second embodiment; 

FIG. 24 shows an example document stored in the infor- 
mation obtaining unit in the second embodiment; 
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FIG. 25 shows an example image stored in the informa- 
tion obtaining unit in the second embodiment; 

FIG. 26 shows the image of FIG. 23 displayed on the 
display screen by using a conventional WWW browser; 

FIG. 27 shows the image of FIG. 23 displayed on the 
display screen by using a conventional WWW browser; 

FIG. 28 shows a font table stored in the data conversion 
table storing unit in the second embodiment; 

FIG. 29 shows a link information conversion table stored 
in the data conversion table storing unit in the second 
embodiment; 

FIG. 30 shows a list of cursor designs stored in the cursor 
design storing unit; 

FIG. 31 shows an example image having been converted 
and stored in the temporary information storage unit in the 
second embodiment; 

FIG. 32 shows an example image having been converted 
and stored in the temporary information storage unit in the 
second embodiment; 

FIG. 33 shows an example piece of link information 
stored in the temporary information storage unit in the 
second embodiment; 

FIG, 34 is a flowchart of the operation in the second 
embodiment; 

FIG. 35 shows the construction of the data conversion 
apparatus in the third embodiment of the present invention; 

FIG. 36 shows a remote controller which transmits signals 
to the signal receiving unit described in the third embodi- 
ment; 

FIG. 37 shows an image and a piece of link information 
stored in the temporary information storage unit m the third 
embodiment; 

FIG. 38 shows an image and a piece of link information 
stored in the temporary information storage unit in the third 
embodiment; 

FIG. 39 shows an image and a piece of link information 
stored in the temporary information storage unit in the third 
embodiment; 

FIG. 40 is a flowchart of the operation in the third 
embodiment; 

FIG. 41 shows an image and a piece of link information 
stored in the temporary information storage unit in the fourth 
embodiment; 

FIG. 42 shows an image and a piece of link information 
stored in the temporary information storage unit in the fourth 
embodiment; and 

f HG. 43 is a flowchart of the operation in the fourth 
embodiment. 

DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

First Embodiment 

FIG. 1 is a block diagram showing the construction of the 
data communication system 100 which is described in the 
present embodiment. This data communication system 100 
is composed of a data transmitting apparatus 110 and a 
plurality of data receiving apparatuses 150. 

The data transmitting apparatus 110 includes an informa- 
tion obtaining unit 111, a transmission data generating unit 
112, a transmission data holding unit 113, a transmission 
data reading unit 114, a multiplexing unit 115, and a trans- 
mitting unit 116. 

Each data receiving apparatus 150 includes a separating 
unit 151, a received data holding unit 152, a reproducing unit 
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153, a display unit 154, a control unit 155, a signal receiving 
unit 156, and an audio output unit 157. 
Construction of the Information Obtaining Unit 111 
The information obtaining unit 111 includes a file list 

5 storing unit 121 and a buffer (not-illustrated) which holds 
information obtained from an external database, such as a 
WWW server. The file list storing unit 121 stores a file list 
200 in which the file names of files that are to be obtained 
by the information obtaining unit 111 and the addresses of 

10 these files are stored corresponding to serial numbers which 
show the order in which the files are to be obtained. 

FIG. 2 shows an example of the file list 200 stored in the 
file list storing unit 121. In the file names given in this list, 
the extension "html" indicates that a file is an HTML 

15 document, the extension "gif ' indicates that a file is an 
image which has been compressed according to GIF 
(Graphics Interchange Format), and the extension "au" 
indicates that a file is audio information in AU format. 
This file list 200 showo in FIG. 2 shows th&case when the 

20 information obtaining unit 111 is connected to the Internet 
and obtains information from WWW servers. In this 
example, the file list 200 is a table in which the URL 
(Uniform Resource Locator) of a directory on a WWW 
server is stored in the address column 202 corresponding to 

25 each number in the serial number column 201. In the present 
example, each page in a home page provided by a WWW 
server can be composed of an HTML document and image 
files and audio files whose file names are indicated by the 
HTML document. As a result, the file name of the HTML 

30 document for each page is grouped together with the file 
names of the accompanying image information files and 
audio files in the file name column 203 of the file list 200. 

It should be noted that there can be cases when the address 
and file names stored in file list storing unit 121 for each 

35 serial number in the file list do not need to be recorded 
separately, so that they may instead be represented using a 
single URL, It is also possible for files to be obtained not 
from a WWW server, but from an external database. In this 
case, the address of the file is expressed as the address of a 

40 device in the external database and the file is expressed by 
a file address in the database. 

The information obtaining unit 111 reads a URL and the 
file names which are to be obtained from the URL from the 
file list storing unit 121 in ascending order of the serial 

45 numbers in column 201. It then accesses the WWW server 
indicated by the URL to obtain the indicated files. The 
information obtaining unit 111 assigns file names to the 
obtained files and stores the files in the buffer. 
Examples of files 

50 The files obtained by the information obtaining unit 111 
are described below, with reference to FIGS. 3, 4, 5, and 6. 

FIG. 3 shows the HTML document 301 "Report.htmr 
which is the first page of a home page provided by a WWW 
server. The notation 'HTML document 301 "Report .html"* 

55 indicates the file of HTML document 301 whose file name 
is "ReporthtmL" 

In HTML documents, character strings written inside 
"o" brackets are called tags. These tags represent control 
codes and are used in pairs written as "<character string>" 

60 and "<:/character string>". The control codes in tags indicate 
the execution of a corresponding control operation. 

Tags "<HTMI>" on fine 311 and "</HTML>" on line 323 
in FIG. 3 indicate that the character strings between these 
tags form a single HTML document 301. 

65 Tags "<H1>" and "</Hl>" on line 312 indicate that the 
character string "WEATHER REPORT" between these tags 
is the headline of this document. 
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Tags "<CENTER>" on line 313 and "</CENTER>" on 
line 315 indicate that the part of the document expressed by 
the character strings between these tags should be centered. 

<<IMG SRO"Weather.gif V on line 314 indicates that 
the image information 401 "Weather.gif ' shown in FIG. 4 is 
to be displayed in the document. Here, "SRO" is an 
attribute of tag "<IMG>" and indicates an image informa- 
tion file. The attribute content of "SRO" is "Weather.gif, 
indicating a file name. 

FIG, 4 shows the image information 401 "Weather.gif * 
which is an image displayed on the first page of the home 
P a S e * 

As shown in FIG. 4, the image information 401 stored m 
image information file "Weather.gif* is a map of Japan 
which includes weather information. 

Tags "<P>" on line 316 and "</P>" on line 317 indicate 
that the character string "TOMORROW, THE WHOLE OF 
JAPAN WILL ENJOY SPRINGLIKE WEATHER" between 
these tags is a single paragraph. 

Tags "<UL>" on line 318 and "</UL>" on line 322 
indicate that the display items expressed by the character 
strings between these tags are displayed as an itemized list 
without serial numbers. 

Each of the tags "<L1>" on lines 319 and 320 indicates 
that the character string between this tag and the next 
"<L1>" or "</UL>" forms an item in the itemized list. 

*<A HREF="Tokyo.html">TOKYO </A>' on line 319 of 
FIG. 3 indicates that the character string "TOKYO" is linked 
to the HTML document 501 "Tokyo.html" which is shown 
in FIG. 5. Here, character strings or images which are linked 
to other files, such as this character string "TOKYO", are 
called hot spots or anchor points. As one example, if a user 
uses the mouse to select the hot spot "TOKYO" which 
displayed on a computer monitor by a browser, the HTML 
document 501 "Tokyo.html" will be read by the browser and 
is displayed on the screen. Here, the attribute of tag "<A>", 
"HREF*", represents a link destination, and the attribute 
content of "HREF«", in this case "Tokyo.html", indicates a 
file name for the link destination file. 

'<A HREF-"Osaka.html">OSAKA </A> 3 on line 320 of 
FIG. 3 indicates that the character string "OSAKA" is linked 
to the HTML document 601 "Osaka.html" which is shown 
in FIG. 6. Accordingly, this character string "OSAKA" is 
also a hot spot. If hot spot "OSAKA" is selected, HTML 
document 601 "Osaka.htmT will be displayed on the screen. 

*<A HREF-"Weather.au">AUDIO INFORMATION 
</A>' on line 321 of FIG. 3 indicates that the character string 
"AUDIO INFORMATION" is linked to the audio file 
"Weather.au.", making it another hot spot. If the hot spot 
"AUDIO INFORMATION" is selected, the audio file 
"Weather.au." will be reproduced. 

FIG. 5 shows the HTML document 501 "Tokychtml" 
which is the second page of the home page. The tags 
included in the HTML document 501 have already been 
explained, so that the following explanation will only deal 
with the links to other pages. 

*<A HREF="Report.html">RETURN <fA>' on line 511 
of FIG. 5 indicates that the character string "RETURN" is 
linked to the HTML document 301 "Report.html" which is 
shown in FIG. 3. 

FIG. 6 shows the HTML document 601 "Osaka.html" 
which is the third page of the home page. 

<<AHREF-"Report.htmi">RETURN </A>' on line 611 
of FIG. 6 indicates that the character string "RETURN" is 
linked to the HTML document 301 "Report.html" which is 
shown in FIG. 3. 

The information obtaining unit 111 may obtain all the files 
listed in the file list 200 in order and store all of the obtained 
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files in its buffer. Alternatively, the information obtaining 
unit 111 may obtain the listed files in units of one page and 
store the obtained files in the buffer. In this latter case, the 
files for a next page are only obtained after the processing of 
5 a current page has been completed by the transmission data 
generating unit 112. 

Construction of Transmission Data Generating Unit 112 

The transmission data generating unit 112 includes a data 
conversion table storing unit 122 and a storage area (not 
10 shown in the drawings) which is used as the work area for 
generating transmission data. The data conversion table 
storing unit 122 includes a tag table, font files, and a link 
information table. The tag table is a list of control operations 
for every available HTML tag which each has its own flag. 
15 The font files each include character fonts for TV display 
which are classified for different purposes. The link infor- 
mation table is a table which expresses the link information 
for hot spots in a format recognized by the data communi- 
cation system 100. The work area is composed of a file 
20 storage area, a tag storage area, a character string storage 
area, and a flag storage area. The file storage area stores one 
HTML document file. The tag storage area stores the char- 
acter strings which are written inside the "<>" brackets of 
each tag. The character string storage area stores character 
25 strings other than the ones between the "<>" brackets. The 
flag storage area is an area where flags which are used for 
controlling the generation of display image information for 
one frame of image data are set. The character strings stored 
in the tag storage area and the character string storage area 
30 are deleted when the control operations corresponding to the 
tags (flags) have been completed. If a plurality of flags are 
present in the flag storage area, the flags are set in ascending 
order and are reset in descending order 

FIG. 7 shows an example of the link information table 700 
35 stored in the data conversion table storing unit 122, where 
the numbers, such as "9", are decimal values. 

As shown in FIG. 7, the link information stored in the link 
information table 700 is composed of index information 701 
and hot spot information 702. 
40 Index information 701 is composed of an information 
identification part "INDEX~" for identifying the informa- 
tion as index information and a file identification number 
expressed as a four-figure decimal value. This file identifi- 
cation number is the identification number of a transmission 
45 data file which includes the current piece of index informa- 
tion 701. 

Hot spot information 702 is composed of an information 
identification part "HOTSPOT=»" for identifying the infor- 
mation as hot spot information, X-Y coordinates "X=999, 
50 Y-999", for indicating a cursor position in the current 
display screen, an instruction "GO„TO„PAGE" which 
corresponds to the cursor position given by these 
coordinates, and a four-figure decimal variable showing the 
identification number of the transmission file linked to this 
55 cursor position. 

The transmission data generating unit 112 treats one set of 
the display image information to be generated along with the 
accompanying audio information and link information as a 
single transmission data file, based on one HTML document. 
60 Here, the transmission data generating unit 112 establishes 
a storage area in each of the display image information 
storing unit 123, the audio information storing unit 124, and 
the link information storing unit 125 which are provided in 
the transmission data holding unit 113 (described later) so 
65 that the display image information, audio information, and 
link information to be included in one transmission data file 
are interretatedly stored. Hereinafter, the storage areas in the 
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display image information storing unit 123, the audio infor- 
mation storing unit 124, and the link information storing unit 
125 are respectively called the display image information 
storage area, the audio information storage area, and the link 
information storage area. 5 

The transmission data generating unit 112 assigns a same 
identification number to the display image information stor- 
age area, the audio information storage area, and the link 
information storage area used for storing the corresponding 
kinds of information in a same transmission data file. Here, 
the transmission data generating unit 112 manages the audio 
information and link information in a same transmission 
data file as separate files which are given the same identi- 
fication number. This identification number may correspond 
to the serial number in column 201 of the file list, which in 
turn corresponds to the file names of the present files which 
are given in column 203. 

The transmission data generating unit 112 fetches an 
unprocessed HTML document file which has been obtained 
by information obtaining unit 111 from the buffer in the 
information obtaining unit 111 in accordance with the serial 
number 201 in the file list 200. The transmission data 
generating unit 112 then writes the file into the file storage 
area of the work area, in addition to generating the index 
information in accordance with the format of the index 
information 701 of the link information table 700. This 
generated index information is then stored at the front of the 
link information storage area in the transmission data hold- 
ing unit 113. 

The transmission data generating unit 112 reads the tags 
in order from the start of the HTML document and interprets 
the tags by looking each tag up in the tag table to find the 
corresponding control operations. This interpretation of con- 
trol operation is performed by writing a character string 
detected after a tag start sign one character at a time into 
the tag storage area provided in the work area until a tag end 
sign "> w is detected. The transmission data generating unit 
112 then matches the character string in the tag storage area 
with a tag written in the tag table. 

For tags which are not "<A>'\ "<IMG>", or "<character 
string preceded by */V\ the transmission data generating 
unit 112 sets a flag showing the interpreted control operation 
in the flag storage area provided in the work area and stores 
the character strings between the start tag "<>" and the 
corresponding end tag"</>" into the character string storage 
area in the work area so as to correspond to the set flag. The 
storage of character strings between a pair of corresponding 
tags is performed in the same way as the storage of the 
character strings included inside the tags themselves. The 
transmission data generating unit 112 converts the character 
strings in the character string storage area into text image 
using the fonts in one of the font files and arranges the text 
image in accordance with the control operation represented 
by the current flag to generate display image information. 
This generated display image information is then added to 
the display image information storage area provided in the 
transmission data holding unit 113. Here, when a start tag 
"<character string>" is followed, not by a character string, 
but by another start tag w <another character string>", a flag 
is first set for the former tag in the flag storage area, before 
the processing is performed for the control operation indi- 
cated by the latter tag. 

If the read tag is "<IMG>", the transmission data gener- 
ating unit 112 fetches the image information file with the file 
name specified by the attribute "SRO" from the buffer of 
the information obtaining unit 111, and decompresses the 
image information file under the format specified by the file 
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name extension to convert the format of the image into an 
appropriate image data format, such as bitmap data or 
graphics data. 

If, for example, the file name extension is ".gif , the 
transmission data generating unit 112 decompresses the 
image information file under GIF to convert the image 
information file into the appropriate format. If a preceding 
flag is set for a control operation to be performed on the 
converted image, the converted image is arranged in accor- 
dance with this control operation to generate display image 
information, otherwise the display image information is 
generated with the converted image being arranged in accor- 
dance with an initial setting. This generated display image 
information is then added to the display image information 
storage area. 

If the read tag is "<A>", the transmission data generating 
unit 112 checks to see if the "link destination file" specified 
by attribute "HREF-" of "<A>" is an audio file which has 
a file name extension, such as M au", which indicates audio 
information. If the link destination file is an audio file, the 
transmission data generating unit 112 fetches the audio file 
from the buffer of the information obtaining unit 111 and 
converts the audio information into audio data of a prede- 
termined format, before storing it in the audio information 
storage area. 

If the link destination file is not an audio file, the trans- 
mission data generating unit 112 generates a text image for 
the character string between tags <A>and <;A>, and 
arranges the text image at a display position indicated by a 
preceding flag, or alternatively at a display position specified 
by an initial setting, with a space being reserved for dis- 
playing a cursor. By doing so, the transmission data gener- 
ating unit 112 generates display image information which is 
then added to the display image information storage area 
provided in the transmission data holding unit 113. The 
transmission data generating unit 112 then calculates the 
X-Y coordinates for the space reserved for the cursor display 
position and refers to the hot spot information 702 in the link 
information table 700 to generate hot spot information from 
the calculated X-Y coordinates and the "fink destination file 
name" specified by the atttibut& "HREF« * of tag "<A>" In 
doing so, the transmission data generating unit 112 refers to 
the file list 200 and finds the serial number 201 correspond- 
ing to the file name in column 203 which in turn corresponds 
to the link destination file name of tag "<A>", before writing 
this serial number 201 into the hot spot information as the 
file identification number. If the link destination file name is 
not present in the file list 200, the transmission data gener- 
ating unit 112 writes the file name of the current file into the 
hot spot information. After doing so, the transmission data 
generating unit 112 adds the generated hot spot information 
to the link information storage area provided in the trans- 
mission data holding unit 113. 

After completing all of the above processes for an HTML 
document, the transmission data generating unit 112 writes 
a graphic representation of the identification number of the 
display image information area at a predetermined position 
in the non-displayed area of the display image information 
stored in the display image information area. In the present 
embodiment, the identification number has been described 
as being a four-figure decimal value, although the number of 
decimal digits is not limited to four. The identification 
number may alternatively be represented in binary notation, 
as a combination of numerals, characters and symbols, as a 
graphical figure, as a bar code, or even as a file name. Here, 
the audio information stored in the audio information stor- 
age area and the link information stored in the link infor- 
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mation storage area are also appended with the identification 
numbers of the corresponding storage areas, in the same way 
as with standard digital data files. 

Through the processes described above, the transmission 
data generating unit 112 generates a first, second, and third 
page of transmission data 800, 900, and 1000, which are 
respectively the first, second, and third pages of the home 
page provided by the WWW server, from the HTML docu- 
ment 301, the audio information not shown in the drawings, 
the image information 401, the HTML document 501, and 
the HTML document 601. 
Transmission Data Generated by 

The Transmission Data Generating Unit 112 

FIGS. 8A to 8C show the transmission data 800 that is the 
first page of the home page provided by the WWW server. 
This first page of transmission data 800 has been generated 
from the HTML document 301, the audio information 
"Weather.au/* and the image information 401. FIGS. 9 A and 
9B show the transmission data 900 that is the second page 
of the home page provided by the WWW server which has 
been generated from the HTML document 501. FIGS. 10A 
and 10B show the third page of transmission data 1000 that 
is the third page of the home page which has been generated 
from the HTML document 601. As shown in FIGS. 8A to 
8C, the transmission data 800 includes the display image 
information 801, the audio information 802, and the link 
information 803 which is related to display image informa- 
tion 801. Here, FIG. 8A shows the display image which is 
the content of the display image information 801, FIG. 8B 
shows a representation of the content of the audio informa- 
tion 802, and FIG. 8C shows the content of the link 
information 803. 

In FIG. 8A, the area surrounded by the dotted line above 
the display image information 801 is a non-displayed area 
which is provided in each set of display image information. 
As its name suggests, this non-displayed area is not dis- 
played on the screen of the display unit 154. An image of an 
identification number, such as "0001" shown in the drawing, 
is written into the top-right corner of the non-displayed area 
by the transmission data generating unit 112. The displayed 
area of display image information 801 is one display image 
which is composed of an image which was originally 
expressed as image information and character strings which 
have been converted from the original character code files 
into images. 

The audio information 802 is linked to the character string 
"AUDIO INFORMATION" which is a hot spot in the 
HTML document 301. Here, the file which includes the 
audio information 802 is also given the identification num- 
ber* "0001", as shown in FIG. 8B, 

The file storing the link information 803 is also given the 
identification number "0001", as shown in FIG. SC. This 
link information 803 is used for control purposes, and is not 
displayed. "<INDEX=0001>" on line 811 of the link infor- 
mation 803 is the index information which indicates that the 
file identification number of the transmission data 800 is 
"0001". 

The character string on line 812 indicates that instruction 
"GO__TO_PAGE(0002)" is related to a position in display 
image information 801 which is specified by the coordinates 
(100,600) and that a cursor image held by the data receiving 
apparatus 150 should be displayed at this position. Instruc- 
tion "GO„TO __PAGE(0002)" indicates that a page haviog 
identification number "0002", which in this case corre- 
sponds to the transmission data 900, should be displayed. 

The character string on line 813 indicates that the instruc- 
tion "GO_TO_PAGE(0003)" is related to a position in the 
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display image information 801 specified by the coordinates 
(100,700) and that a cursor image held by the data receiving 
apparatus 150 should be displayed at this position. This 
instruction "GO„TO__PAGE(0003)" indicates that a page 
5 having identification number "0003", which in this case 
corresponds to the transmission data 1000, should be dis- 
played. 

FIGS. 9 A and 9B show the transmission data 900 which 
is the second page of the home page provided by the WWW 

10 server. This transmission data 900 includes the display 
image information 901 and the link information 902, which 
is related to the display image information 901. Here, FIG. 
9A shows the display image which is the content of the 
display image information 901 and FIG. 9B shows the 

15 content of the link information 902. 

As shown in FIG. 9 A, an image of the identification 
number "0002" is written in the top-right comer of the 
non-displayed area of the display image information 901 
which is shown by the dotted fine, in the same way as with 

20 the display image information 801. 

As shown in FIG. 9B, the file storing link information 902 
is given the identification number "0002". 

In FIG. 9B, <INDEX*0002>on line 911 is the index 
information, indicating that the file identification number for 

25 transmission data 900 is "0002". 

The character string on line 912 indicates that the instruc- 
tion "GO__TO_PAGE(0001)" is related to a position in the 
display image information 901 specified by coordinates 
(050,400) and that a cursor image held by the data receiving 

30 apparatus 150 should be displayed at this position. This 
instruction "GO__TO_JPAGE(0001)" indicates that a page 
having identification number "0001," which in this case 
corresponds to the transmission data 800, should be dis- 
played. 

35 FIG . 10A and 10B show the transmission data 1000 which 
is the third page of the home page provided by the WWW 
server. Transmission data 1000 includes display image infor- 
mation 1001 and link information 1002, which is related to 
display image information 1001. Here, FIG. 10A shows the 

40 display image which is the content of the display image 
information 1001 and FIG. 10B shows the content of the link 
information 1002. 

As before, an image of the identification number "0003" 
is written into the top-right corner of the non-displayed area 

45 of display image information 1001. 

As shown in FIG. 10B, the file storing link information 
1002 is given the identification number "0003". 

"<INDEX=0003>" on line 1011 of the link information 
1002 is the index information, indicating that the identifi- 

50 cation number of the files of the transmission data 1000 is 
"0003". 

The character string on line 1012 indicates that the 
instruction "GO_JTO_PAGE(0OO1)" is related to a position 
in the display image information 901 specified by the 

55 coordinates (050,400) and that a cursor image should be 
displayed at this position. This instruction "GO„TO PAGE 
(0001)" indicates that a page having identification number 
"0001", which in this case corresponds to transmission data 
800, should be displayed. 

60 Illustrative Example of the Processing by the Information 
Obtaining Unit 111 and the Transmission Data Generating 
Unit 112 

The following is a specific example of the processing 
performed by the information obtaining unit 111 and the 
65 transmission data generating unit 112 in which the files 
shown in FIGS. 3, 4, 5, and 6 are obtained and are used to 
generate the transmission data shown in FIGS. 8, 9, and 10. 
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Processing by the Information Obtaining Unit 111 

The information obtaining unit 111 first refers to the file 
list storing unit 121 and issues a connection request to the 
indicated WWW server on the Internet. The information 
obtaining unit 111 then obtains the HTML document 301 
t( Report.html" from this WWW server, assigns it the file 
name "Report.html", and stores the file in the buffer. The 
information obtaining unit 111 also obtains the compressed 
image information 401, the HTML document 501, and the 
HTML document 601 in the same way from the WWW 
server. 

Processing by the Transmission Data Generating Unit 112 
The transmission data generating unit 112 allocates stor- 
age areas in the transmission data holding unit 113 for 
respectively storing the display image information 801, the 
audio information 802, and the link information 803 which 
compose the transmission data 800. In doing so, the trans- 
mission data generating unit 112 assigns the identification 
number "0001" for retrieving transmission data 800 to these 
storage areas. The transmission data generating unit 112 then 
fetches the (yet-unprocessed) HTML document 301 from 
the buffer of the information obtaining unit HI and writes 
this document into the file storage area in the work area. 

The transmission data generating unit 112 then generates 
the index information "<INDEX~0001>" shown in line 811 
of the transmission data 800 for the first page of the WWW 
home page from the file name "Report.htmF' of HTML 
document 301, before storing the generated index informa- 
tion at the start of the link information storage area for link 
information 803 which is provided in the transmission data 
holding unit 113. 

The transmission data generating unit 112 then reads the 
tag "<HTML>" from line 311 in the HTML document 301 
and stores the character string "HTML" in the "<HTML>" 
tag in the tag storage area of the work area. It then refers to 
the tag table stored in the data conversion table storing unit 
122 to interpret the tag, and by doing so recognizes that line 
311 is the first line of the HTML document 301. After doing 
so, it deletes the character string "HTML" from the tag 
storage area. 

Next, the transmission data generating unit 112 reads the 
tag "<H1>" on line 312 and refers to the tag table to interpret 
its content. On doing so, it sets the headline flag in the flag 
storage area in the work area. Here, the headline flag shows 
that the character string following the "<H1>" tag is a 
headline and so should be displayed using a headline font. 
The characters in the character string after the "<H1>" tag 
are then written one character at a time into the character 
string storage area until the "</Hl>" tag appears, which in 
thi present case results in the character string "WEATHER 
REPORT' being written into the character string storage 
area and being converted into display image information 
using the headline font. This generated display image infor- 
mation is then added to the display image information 
storage area set in the transmission data holding unit 113. 
After this, the headline flag in the work area is reset, the 
character string "WEATHER REPORT" is deleted from the 
character string storage area, and the character string "HI" 
is deleted from the tag storage area. 

Next, the transmission data generating unit 112 reads the 
tag ' ( <CENTER>" on line 313 and sets the centering flag in 
the work area. The centering flag shows that the character 
string which follows the corresponding tag is to be centered 
on the display. Here, there is no character string following 
the "<CENTER>" tag which can be centered, so that the 
transmission data generating unit 112 continues by reading 
line 314. 
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The transmission data generating unit 112 reads the tag 
*<IMG SRO" Weather.gif V on line 314 and refers to the 
tag table to interpret the content of the tag. The transmission 
data generating unit 112 then investigates whether the file 

5 for the image information 401, which is expressed by the file 
name "Weather.gif is present in the buffer of the informa- 
tion obtaining unit 111, and, since this is the case, reads the 
file. The transmission data generating unit 112 then converts 
the image information 401 which is stored and compressed 

10 in the read file into a bitmap image or other such format, in 
accordance with a GIF decompression method. 

The transmission data generating unit 112 then reads the 
tag "</CENTER>" on line 315 and arranges the bitmap 
image converted from image information 401 in accordance 

15 with the centering flag set in the work area. The display 
image information thus generated is then added to the 
display image information storage area in the transmission 
data holding unit 113, before the centering flag in the work 
area is reset. 

20 The transmission data generating unit 112 then reads the 
"<P>" tag on line 316 and sets the paragraph flag. The 
paragraph flag shows that the character strings displayed 
between this start tag and the "</P" end tag should be 
displayed as a single paragraph which is to be inserted into 

25 the following blank line. As with "WEATHER REPORT* on 
fine 312, the character string "TOMORROW, THE WHOLE 
OF JAPAN WILL ENJOY SPRINGLIKE WEATHER" 
between these tags is read and is stored in the character 
string storage area in the work area. Next, after reading the 

30 "</P>" tag, the transmission data generating unit 112 con- 
verts the character string "TOMORROW, THE WHOLE OF 
JAPAN WILL ENJOY SPRINGLIKE WEATHER" into an 
image using the font for paragraph display which is stored 
as one of the font files and adds the generated display image 

35 information to the storage area in the transmission data 
holding unit 113 for display image information storage area 
801. After this, the content of the work area is cleared as 
before. 

The transmission data generating unit 112 next reads the 
40 tag "<U1>" on line 318, interprets it, and sets the itemized 
list flag in the work area. The itemized list flag shows that 
each character string which follows the tag and is interpreted 
as one item should be displayed as a non-numbered item in 
a list. 

45 The transmission data generating unit 112 next reads the 
tag "<L1>" on line 319, refers to the tag table, interprets the 
tag as indicating the start of one item in a list, and sets the 
item^flag in the flag storage area. The item flag shows that 
the display position on the display screen should be shifted 

50 to the next line every time an "<L1>" or "</Ll>" tag is read. 
The transmission data generating unit 112 reads the tag 
"<A HREF="Tokyo.html>" following the tag "<L1>" and 
writes it into the tag storage area. The transmission data 
generating unit 112 then interprets this tag "<A HREF- 

55 u Tokyo.html>" and sets the link flag in the flag storage area. 
When the extension of the file name given as the attribute 
of the "<A>" tag indicates audio information, the link flag 
shows that processing for the audio information is to be 
performed so that the audio information is converted into a 

60 predetermined format and stored in the audio information 
storage area. When the extension of the file name given as 
the attribute of the "<A>" tag does not indicate audio 
information, the link flag shows that the character string 
between the "<A>" and "</A>" tags which is appended with 

65 the link by the "<A>" tags is to be converted into an image 
with a two-character space provided before it as a cursor 
display area. The link flag also shows that display image 
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information is to be generated for this character string in 
addition to hot spot information which is generated in 
accordance with the format of the hot spot information 702. 

The transmission data generating unit 112 reads the 
character string "TOKYO" between the "<A HREF= 
'Tokyo.htrruV' and "</A>" tags and writes it into the 
character string storage area. After reading the "</A>" tag, 
the transmission data generating unit 112 converts the char- 
acter string "TOKYO" into an image with a two-character 
space provided before it as a cursor display area and 
arranges the character string in accordance with the itemized 
list flag to generate display image information which it adds 
to the display image information storage area provided in the 
transmission data holding unit 113. The transmission data 
generating unit 112 then calculates the coordinates of the 
cursor display position as (100,600), and uses these coordi- 
nates and the attribute 'Tokyo.html" stored in the tag storage 
area of the work area to generate the hot spot information 
shown on line 812 of FIG. 8. After doing so, the transmission 
data generating unit 112 adds the generated hot spot infor- 
mation to the link information storage area provided in the 
transmission data holding unit 113. Having done so, the 
transmission data generating unit 112 deletes the character 
string "AHREF«"Tokyo.htznr' in the tag storage area of the 
work area and the character string "TOKYO" in the char- 
acter string storage area, in addition to resetting the link flag. 

Next, on reading the "<L1>" tag on line 320, the trans- 
mission data generating unit 112 shifts the display position 
for the next display image to the following line in accor- 
dance with the item flag, and, in the same way as with line 
319, generates display image information for the character 
string "OSAKA*', in addition to generating the hot spot 
information shown on line 813 of FIG. 8C. The generated 
display image information is then added to the display image 
information storage area provided in the transmission data 
holding unit 113 and the generated hot spot information is 
added to the link information storage area. After this, the 
transmission data generating unit 112 deletes the character 
string "A HREF-"Osaka.htmr and the character string 
"OSAKA", and resets the link flag. 

Next, on reading the "<L1>" tag on line 321, the trans- 
mission data generating unit 112 shifts the display position 
for the next display image to the following line in accor- 
dance with the item flag, and sets the link flag in accordance 
with the tag "A HREF* "We ather.au". On investigating the 
file name extension of the attribute in accordance with the 
link flag, the transmission data generating unit 112 finds that 
the link destination file is audio information in AU format, 
so that it converts the AU format audio information into 
audio information of a predetermined format, before storing 
the converted audio information in the audio information 
storage area provided in the transmission data holding unit 
113. 

Next, on reading the W </L1 >" tag on line 322, the trans- 
mission data generating unit 112 interprets that the itemized 
list is complete, and resets the itemized list flag and the item 
flag. 

Finally, on reading the "</HTML>" tag on line 323, the 
transmission data generating unit 112 interprets that the 
HTML document 301 has ended, and so terminates the 
generation process for transmission data 800. 

Following this, the transmission data generating unit 112 
finds that there is an unprocessed HTML document 501 and 
so sets a display image information storage area for display 
image information 901 and a link information storage area 
for link information 902 in the transmission data holding 
unit 113 for storing the composite parts of the transmission 
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data 900, in doing so giving both storage areas the identi- 
fication number "0002" for the retrieval of the transmission 
data 900. It then reads the unprocessed HTML document 
501 from the buffer of the information obtaining unit HI and 

5 writes it into the work area. 

The transmission data generating unit 112 then generates 
the index information "<1NDEX=0002>" shown in line 911 
of the transmission data 900 which displays the second page 
of the WWW home page from the file name "Tokyo.htmr 

10 of the HTML document 501, before storing the generated . 
index information at the start of the link information storage 
area for the link information 902 which is provided in the 
transmission data holding unit 113. In the same way as with 
the generation of the transmission data 800 from the HTML 

15 document 301 and the image information 401, the transmis- 
sion data generating unit 112 then generates the transmission 
data 900 from the HTML document 501 and the transmis- 
sion data 1000 from the HTML document 601, with no 
further explanation of this process being given. 

20 Construction of the Transmission Data Holding Unit 113. 
the Transmission Data Reading Unit 114, the Multiplexing 
Unit 115, and the Transmitting Unit 116 

The transmission data holding unit 113 includes a display 
image information storing unit 123, an audio information 

25 storing unit 124, and a link information storing unit 125, 
with simultaneous retrieval from these units being possible. 

The display image information storing unit 123 can be 
realized by RAM (Random Access Memory) or a hard disk 
device, and is provided with a plurality of display image 

30 information storage areas which are set by the transmission 
data generating unit 112. Each of these display image 
information storage areas stores one file of display image 
information which is generated by the transmission data 
generating unit 112, 

35 The audio information storing unit 124 can also be 
realized by RAM (Random Access Memory) or a hard disk 
device, and is provided with a plurality of audio information 
storage areas which are set by the transmission data gener- 
ating unit 112. Each of these audio information storage areas 

40 stores one file of audio information which is generated by 
the transmission data generating unit 112. 

The link information storing unit 125 can also be realized 
by RAM (Random Access Memory) or a hard disk device, 
and is provided with a plurality of link information storage 

45 areas which are set by the transmission data generating unit 
112. Each of these link information storage areas stores one 
file of link information which is generated by the transmis- 
sion data generating unit 112. 

The transmission data reading unit 114 simultaneously 

50 reads the display image information, the audio information, 
and the link information in a same transmission data file 
from the storage areas provided in the transmission data 
holding unit 113 in the order of the file identification 
numbers for the transmission data, and outputs the read 

55 information to the multiplexing unit 115, After reading the 
files for the transmission data which has the final identifi- 
cation number, the transmission data reading unit 114 
returns to the transmission data with the identification num- 
ber 0001" and once again reads the transmission data in the 

60 order of the identification numbers. This is to say, the 
transmission data reading unit 114 cyclically reads the 
transmission data from the transmission data holding unit 
113 in order of identification numbers and outputs the 
transmission data to the multiplexing unit 115. In doing so, 

65 there is the following difference in the reading method when 
audio information is or is not present. When no audio 
information is present, the transmission data reading unit 
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114 advances to the reading of a set of transmission data 
with the aext identification number after reading a first set of 
transmission data once. When audio information is present, 
the transmission data reading unit 114 reads the audio 
information and advances to the reading of a set of trans- 
mission data with the next identification number only after 
reading the display image information and the link infor- 
mation a plurality of times for the period which is required 
by the reproduction of the audio information. As one 
example, if the audio information has a reproduction period 
of two seconds, the transmission data reading unit 114 will 
read the audio information once, and will read the display 
image information and link information 60 times (30 frames 
per second*2 seconds), before advancing to the reading of a 
set transmission data with the next identification number. In 
this way, the transmission time for audio information can be 
maintained. 

The multiplexing unit 115 multiplexes the display image 
information (including the audio information) and the link 
information read by the transmission data reading unit 114, 
and outputs multiplexed data to the transmitting unit 116. 
Here, this multiplexing can be performed using the same 
method as conventional teletext broadcasting. In such a case, 
display image information and audio information are mul- 
tiplexed in the same way as the images and audio included 
in conventional TV broadcasts, while link information is 
multiplexed in the same way as the text information multi- 
plexed with teletext broadcasts. This is to say, when no audio 
information is present, the display image information is 
transmitted in the image section of one frame of the televi- 
sion image signal, while the link information is transmitted 
in the retrace section of the same one frame of the television 
image signal. When audio information is present, the audio 
information is transmitted as the television audio signal, 
while the corresponding display image information and link 
information are transmitted in the image area and retrace 
area, respectively, of the television image signal for the 
number of frames required by the reproduction of the audio 
information. 

The transmitting unit 116 successively transmits the trans- 
mission data which has been multiplexed by the multiplex- 
ing unit 115 on a TV broadcast ground wave. 
Transmission Method for the Transmission Data 

FIG. UA gives a graphic representation of the transmis- 
sion method used by the transmitting unit 116. FIG. HA 
shows the case when n pages (n being a positive integer) of 
transmission data are generated by the transmission data 
generating unit 112. In FIG. UA, a pairing of audio infor- 
mation and display image information with a same identi- 
fication number is expressed as one transmission unit cor- 
responding to a normal TV broadcast, and the link 
information for the same identification number is expressed 
as one transmission unit corresponding to the text informa- 
tion which is multiplexed into a standard teletext broadcast. 

As shown in FIG. 11 A, in addition to being identified by 
the same identification number, the display image 
information, audio information, and link information stored 
in one transmission data file are transmitted at a correspond- 
ing time. Also, the transmission data from the first to the nth 
page in the transmission data holding unit 113 are cyclically 
transmitted in the order of identification numbers. 

It should be noted here that while the transmission data 
reading unit 114 has been described as reacting the display 
image information, the audio information, and the link 
information stored in the same transmission data file simul- 
taneously from the display image information storing unit 
123, the audio information storing unit 124, and the link 
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information storing unit 125 and as having the read display 
image information, audio information, and link information 
transmitted with related identification numbers and trans- 
mission timing, the display image information and the link 

5 information do not need to be transmitted with a related 
timing. As one example, the transmission data reading unit 
114 may instead be composed of a first reading unit and a 
second reading unit. Here, the first reading unit is con- 
structed to continuously read pairs of display image infor- 

iQ mation from the display image information storing unit 123 
and audio information from the audio information storing 
unit 124 which it then outputs to the multiplexing unit 115. 
The second reading unit is constructed to continuously read 
only the link information from the link information storing 
unit 125 which it then outputs to the multiplexing unit 115. 

35 By doing so, the display image information and link infor- 
mation belonging to a same transmission data file do not 
need to be transmitted by the transmitting unit 116 at the 
same time, since the data receiving apparatus 150 can use 
the identification number commonly given to the display 

20 image information and the link information to recombine 
pairs of the display image information and the link infor- 
mation. 

The multiplexing unit 115 has also been described as 
multiplexing the display image information (including the 

25 audio information) and the link information which are 
generated by the transmission data generating unit 112, with 
the transmitting unit 116 transmitting the transmission data 
which has been multiplexed by the multiplexing unit 115 on 
a TV broadcast ground wave, although the display image 

30 information and link information do not need to be multi- 
plexed together for transmission. As one example, the dis- 
play image information and the audio information may be 
transmitted on a TV broadcast ground wave or as a digital 
satellite broadcast, while the link information may be trans- 

35 mitted using a telephone link and modem, or the like. 
Transmission here may alternatively be performed using 
multiple channels. 

When digital satellite broadcasting is used as the data 
transmission method, compression/encryption and multi- 

40 plexing may be performed according to MPEG2 (Moving 
Pictures Experts Group) video standard and system 
standard, so that display image information may be set as I 
pictures, with the audio information and link information 
being set as private information. Here, when it is possible for 

45 the display image information, audio information, and link 
information to be transmitted as digital data, it is no longer 
necessary to write a graphic representation of the identifi- 
cation number into the non-displayed area of the display 
image information, so that the identification number can be 

50 simply appended to the display image information and audio 
information, in the same way as with the link information. 
Incidentally, a detailed description of MPEG2 standard is 
given in "Saishin MPEG Kyoukasho [Latest MPEG 
Reader]" published by ASCII Publishing, Inc. 

55 FIG. 11B shows the multiplexed stream which is trans- 
mitted when digital satellite broadcasting is used. The upper 
part of this drawing shows a transport stream under MPEG2 
standard which has been generated by the multiplexing unit 
115. 

60 The symbols "VI, Al, LI" in the transport stream rep- 
resent the display image information, audio information, and 
link information which have the identification number 
"0001" and which are read from the transmission data file 
and multiplexed together. This is also the case for "V2, A2, 

65 L2". . . "Vn,An,Ln". 

"VI" is a video elementary stream which shows the 
display image information which has been converted into I 
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(Intra) pictures under MPEG2 standard, with the PID 
(Packet IDentifier) "0x0100'* having been attached to iden- 
tify the stream. This is also the case for "V2" . . . "Vn". 

"Al" is an audio elementary stream which shows the 
audio information which has been converted under MPEG2 
standard, with the PID "0x0101" having been attached to 
identify the stream. This is also the case for "A2" . , . "An". 

"Ll-Ln" are private sections according to MPEG2 stan- 
dard for attaching each set of link information, with the PID 
"OxBO" having been attached to identify these as private 
sections. Here, identification numbers are also set in the 
table ID extensions to identify separate sets of link infor- 
mation. Each of these sets of link information is set with at 
least one pairing of one part of the image area of the 
corresponding display image and information showing a link 
to another display image. As one example, in "LI", the 
display area centered on the coordinates (X,Y)=(100,600) is 
set with the link "GOTO_PAGE(0002)" representing a link 
to the display image with the identification number "0002", 
while the display area centered on the coordinates (X,Y)=» 
(100,700) is set with the link "GOTO_PAGE(0003y* rep- 
resenting a link to the display image with the identification 
number "0003". 

The correspondence between the PIDs described above 
and the identification numbers is set according to the PMT 
(Program Map Table) under MPEG2 standard. Here, the 
correspondence between the PIDs and the identification 
numbers can be written in the descriptors of the private 
sections, such as by setting the identification numbers as the 
component tags in the PMT, as shown in FIG. 11B. 

In the above case, the video elementary stream, audio 
elementary stream, and private sections are generated by the 
transmission data generating unit 112 and are stored in the 
transmission data holding unit 113. Here, a set of one video 
elementary stream, one audio elementary stream, and one 
private section stored in the transmission data holding unit 
113 corresponds to one transmission data file. Here, the 
video elementary stream, audio elementary stream, and 
private section stored as one set in the transmission data 
holding unit 113 are each read once, with the transmission 
data reading unit 114 cyclically reading all of the transmis- 
sion data files. Using this data, transport streams are gener- 
ated by the multiplexing unit 115. 

As described above, by multiplexing n sets of display 
image information, audio information, and link information 
with a PMT in the transport stream, transmission data can be 
easily transmitted using digital satellite broadcasting. 
Overview of the Procedure of the 
Data Transmitting Apparatus 110 
The following is a detailed explanation of the procedure 
of the data transmitting apparatus 110, with reference to 
FIGS. 12 to 14. 

FIG. 12 is a flowchart showing an overview of the 
procedure of the data transmitting apparatus 110. 

The information obtaining unit 111 obtains a desired set of 
information from an external database and stores it in its 
internal buffer (step S1101). 

The transmission data generating unit 112 interprets the 
information obtained by the information obtaining unit 111 
and generates display image information, audio information, 
and link information, which it stores in the transmission data 
holding unit 113 (step S1102). 

The transmission data reading unit 114 successively reads 
the transmission data from the transmission data holding 
unit 113 in order of identification numbers (step S1103) 

The multiplexing unit 115 multiplexes the display image 
information (including the audio information) with the link 
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information, and the transmitting unit 116 transmits the 
multiplexed transmission data using a television broadcast 
ground wave. 

Procedure of the Information Obtaining Unit 111 
5 FIG. 13 is a flowchart showing an example information 
obtaining procedure of the information obtaining unit 

The information obtaining unit 111 first refers to the file 
list in the file list storing unit 121 and checks whether there 
is any as-yet-unobtained information (step S1201). If there 
10 is not, the information obtaining procedure is terminated. If 
there is, the file addresses (or URLs) of the as-yet- 
unobtained sets of information are fetched one at a time (step 
S1202). 

The information obtaining unit 111 then requests a con- 
is nection with an external database, based on the fetched 
address (step S1203), and checks whether the connection 
has been successively established (step S1204). If the con- 
nection is unsuccessful, the processing returns to step S12Q3 
(step S1204). 

20 If the connection has been successful, the information 
obtaining unit 111 reads the file names of the as-yet- 
unobtained information from the file list, obtains the corre- 
sponding files from the external database, and stores them in 
the internal buffer (step S1205). The processing then returns 
25 to step S1201. 

Procedure of the Transmission Data Generating Unit 112 

FIG. 14 is a flowchart showing an example procedure for 
generating transmission data by the transmission data gen- 
erating unit 112. 
30 The transmission data generating unit 112 first refers to 
the buffer in the information obtaining unit 111 and checks 
whether any unprocessed HTML documents exist (step 
S1301). If no such documents exist, the display image 
generating procedure is terminated. If there is such a 
35 document, the transmission data generating unit 112 estab- 
lishes the transmission data storage areas in the transmission 
data holding unit 113, assigns an identification number to 
each transmission data storage area, and then fetches an 
unprocessed HTML document from the buffer (step S1302). 
40 The transmission data generating unit 112 creates index 
information indicative of the file name of the transmission 
data from the file name of the fetched HTML document, and 
adds the index information to the link information storage 
area established in the transmission data holding unit 113 
45 (stepS1303). 

One character is read from the fetched HTML document 
and is written into the character string storage area (step 

51304) . 

The transmission data generating unit 112 then checks 
50 whether the read character is a tag start sign (step 

51305) . If so, the processing advances to step S1307, or if 
not, the character is added to the character string storage area 
in the work area, and the processing returns to step S1304 
(step S1306). 

55 The next character is read (step S1307), and the trans- 
mission data generating unit 112 judges whether the read 
character is a tag end sign (step S1308). If so, the 
processing advances to step S1310, or if not, the read 
character is added to the tag storage area in the working area, 
60 before the processing returns to step S1307 (step S1309) 
The character string in the tag storage area is compared 
with the tag table, and a check is performed to see whether 
it starts with a V sign (step S1310). If it does, the trans- 
mission data generating unit 112 judges whether the read tag 
65 is a "</HTML>" tag (step S1311). If so, the transmission 
data generating unit 112 resets the work area, and the 
processing returns to step S1310. If the read tag is not 
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U </KTML>'\ the transmission data generating unit 112 
operates in accordance with the least significant of the flags 
set in the flag storage area corresponding to this read tag, and 
resets the corresponding storage area in the work area (step 
S1312), before the processing returns to step S1304. 

In step S1310, when the character string does not start 
with "/", a check is performed to see whether the read tag is 
"<IMG>" (step S1313). If so, the transmission data gener- 
ating unit 112 fetches the image information file specified by 
the attribute of the "<IMG>" tag from the buffer in the 
information obtaining unit 111 (step S1314). The fetched 
image information is converted in accordance with a GIF 
decompression method into image information expressed as 
bitmap data (step S1315), and the processing returns to step 
S1304. 

If the read tag is not "<IMG>", the character string in the 
tag storage area is compared with the content of the tag table 
and a flag corresponding to the tag is set in the flag storage 
area. The transmission data generating unit 112 then oper- 
ates in accordance with this tag (step S1316), before the 
processing returns to step S1304. 

A variety of tags can be employed in the HTML 
documents, and the processes represented by these tags can 
be performed in the same way as a conventional browser. 
Accordingly, the following explanation focuses on an 
example of the processing in step S1312 for the tag "</A>" 
which relates to the link information which generated in a 
special format for this data communication system 100. 

FIG. 15 is a flowchart showing a detailed example of the 
processing in step S1312 of FIG. 14. 

The transmission data generating unit 112 first checks 
whether the read tag is "<A>" (step S1401), and if not, the 
processing advances to step S1408. 

If the read tag is "<A>", the transmission data generating 
unit 112 judges whether the link destination file specified by 
the attribute is an audio information file (step S1402). If it 
is, the processing advances to step S1407, or if not, the 
transmission data generating unit 112 generates display 
image information for the character string established in the 
character string storage area, in doing so leaving a display 
area for displaying a cursor design, before adding the 
generated display image information to the display image 
information storage area provided in the transmission data 
holding unit 113 (step S1403). 

The transmission data generating unit 112 then calculates 
the X-Y coordinates which express the display position of 
the cursor design (step S1404). 

The transmission data generating unit 112 then generates 
hot spot information based on the calculated X-Y coordi- 
nates and the attribute established in the tag storage area, and 
adds it to the link information storage area provided in the 
transmission data holding unit 113 (step S1405). 

The transmission data generating unit 112 then resets the 
link flag in the work area, and deletes the character string in 
the tag storage area and the character-sequence storage area 

(step simy 

The transmission data generating unit 112 fetches an 
audio information file and converts the audio information 
contained in the file into information of a predetermined 
format which it stores in the audio information storage area 
(step S1407). 

The transmission data generating unit 112 operates in 
accordance with the read tag (step S1408). 
Structure of the Data Receiving Apparatus 150 

The following is an explanation of the components of the 
data receiving apparatus 150, with reference to FIGS, 16 to 
20. 
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Structure of the Separating Unit 151 

The separating unit 151 includes a read buffer 161 for 
reading the identification number allotted to transmission 
data. The read buffer 161 has storage areas for temporarily 

5 holding the display image information (including audio 
information) included in one transmission file and the link 
information included in one transmission file. 

The separating unit 151 separates display image informa- 
tion (including audio information) and link information from 

10 the received transmission data, and stores the separated 
display image information and link information in the cor- 
responding storage areas of the read buffer 161. The iden- 
tification number assigned to the display image information 
stored in the storage area is read by recog ni z i ng the image 

15 written in the predetermined part of the non-displayed area 
of the display image information. The identification number 
assigned to the link information is read in the same manner • 
as when reading an identification number assigned to a 
conventional digital data file. If the read identification mm> 

20 ber is the identification number designated by the control 
unit 155, the display image information (including audio 
information) or the link information held by the read buffer 
161 is stored in the corresponding storage area in the 
received data holding unit 152. At this point, any audio 

25 information which is present is stored by the separating unit 
151 in a corresponding storage area provided in the received 
data holding unit 152 at the same time as the display image 
information is stored, so that the audio information is 
gradually accumulated while the display image information 

30 with the identification number designated by the control unit 
155 is repetitively transmitted. By doing so, audio informa- 
tion which is transmitted across a plurality of frames can be 
separated from the transmission data. 

If the read identification number is not the identification 

35 number designated by the control unit 155, the display 
image information (including audio information) or its link 
information held by the read buffer 161 is discarded. The 
reading of new display image information (including audio 
information) and link information is continued, and the 

40 above procedure is repeated until the identification number 
designated by the control unit 155 is detected. 
Structures of the Received Data Holding Unit 152, the 
Reproducing Unit 153, and the Display Unit 

45 The received data holding unit 152 stores display image 
information (including audio information) and link informa- 
tion separated by the separating unit 151 linked with their 
assigned identification number. The storage area for storing 
the display image information can be achieved by RAM or 

50 a hard disk device capable of storing one static image which 
is the size of the display screen. 

The reproducing unit 153 reproduces the display image 
information stored in the received image holding unit 152 
along with the graphics information (described later) input- 

55 ted from the control unit 155, in accordance with an indi- 
cation which it receives from the control unit 155. The 
reproducing unit 153 outputs the reproduced image to the 
display unit 154. The reproducing unit 153 also reproduces 
the stored audio information in synchronization with the 

60 reproduction display image information and outputs the 
reproduced audio to the audio output unit 157. 

The display unit 154 can be realized by a television 
monitor which displays images according to NTSC 
(National Television System Committee) standard, and is 

65 used to display the display image and cursor design on its 
screen, in accordance with the input from the reproducing 
unit 153. 
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Structure of the Control Unit 155 

The control unit 155 sets an initial value in the register 
storing a variable (described later), and instructs the sepa- 
rating unit 151 to fetch the display image information 
(including audio information) and link information of a page 5 
specified by this initial value, which as one example can be 
the identification number "0001". 

The control unit 155 instructs the reproducing unit 153 to 
reproduce the display image information (including audio 
information), every time new display image information 10 
(including audio information) is stored in the received data 
holding unit 152. Every time new link information is stored 
in the received data holding unit 152, the control unit 155 
interprets the link information and generates a cursor design 
correspondence table in which cursor designs (described 35 
later) are generated for each cursor display position. These 
cursor designs are expressed by cursor information which is 
held inside the control unit 155. The control unit 155 outputs 
design information expressing a cursor design together with 
the cursor position to the reproducing unit 153, as well as 20 
indicating the reproduction of the cursor design. 

FIG. 16 shows an example of the cursor design corre- 
spondence table which the control UDit 155 generates to 
control the display position of the cursor design. 

The cursor design correspondence table shows the corre- 25 
spondence between each cursor display position which is 
expressed in the hot spot information in the link information 
stored in the received data holding unit 152 and the cursor 
number for the cursor design to be displayed at each cursor 
display position. The control unit 155 assigns cursor num- 30 
bers to each cursor display position in the link information 
in order of lowest Y coordinate and then lowest X 
coordinate, as one example, and writes each display position 
into the item with corresponding cursor number in the cursor 
design correspondence table. 35 

FIG. 17 shows an example of the design information 
stored by the control unit 155. As shown in FIG. 17, the 
control unit 155 stores cursor information which expresses 
a cursor design for each cursor number when the number is 
selected (referred to as the "selection state") and a cursor 40 
design for each number when the number is not selected 
(referred to as the "non-selection state"). 

On receiving an interrupt from the signal receiving unit 
156, the control unit 155 interprets the type of input signal 
stored in the signal receiving unit 156, selects the design 45 
information of the corresponding cursor design, and outputs 
the cursor information to the reproducing unit 153. Follow- 
ing this, the control unit 155 controls the handling of the 
received data by the separating unit 151, in accordance with 
the cursor whose selection has been confirmed. 50 
Display Control Procedure for the Received Data 

The following is a detailed explanation of the display 
control procedure by the control unit 155 for a set of 
received data, a set of received data referring to display 
image information (including audio information) and link 55 
information which have been stored in corresponding stor- 
age areas in the received data holding unit 152 by the 
separating unit 151 and which have the same identification 
number. 

The control unit 155 sets a predetermined value, such as 60 
*T\ into the variable "P-Index" which expresses the iden- 
tification number of the received data to be displayed. The 
control unit 155 then sets a predetermined value, such as 
"1", into the variable "Cur-Pos" showing the cursor number 
which is in the selection state. Following this, the control 65 
unit 155 instructs the separating unit 151 to obtain the 
transmission data indicated by the variable "P-Index". The 
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control unit 155 then interprets the link information in the 
received data which is received in accordance with this 
instruction and is stored in the received data holding unit 
152, and outputs the cursor information for each cursor, the 
cursor indicated by the variable Cur-Pos being in the selec- 
tion state, together with the display position to the repro- 
ducing unit 153. Here, when an interrupt from the signal 
receiving unit 156 occurs, the control unit 155 interprets the 
control signal stored in the signal receiving unit 156. First, 
the control unit 155 checks whether the input signal was 
"Up", in which case the control unit 155 decreases the value 
of variable Cur-Pos by 1. If not, the control unit 155 checks 
whether the input signal was "Down", in which case the 
control unit 155 increases the value of variable Cur-Pos by 
1 . If not, the control unit 155 checks whether the input signal 
was "Enter", in which case the control unit 155 finds the 
coordinates of the display position from the cursor number 
given by the variable Cur-Pos, and obtains the identification 
number of the file which is the link destination file written 
in the hot spot information for these coordinates. The control 
unit 155 then sets this identification number in the variable 
P-Index, and instructs the separating unit 151 to obtain the 
transmission data shown by the variable P-tndex. 
Structure of the Signal Receiving Unit 156 and the Audio 
Output Unit 157 

On receiving an input signal from a remote controller 
(not-illustrated) or the like, the signal receiving unit 156 
creates an interrupt for the control unit 155 in accordance 
with the received input signal, as well as holding the 
received input signal. 

The audio output unit 157 can be realized by a speaker or 
the like, and is used to output the reproduced audio infor- 
mation as audio. 
Example of a Display Image 

FIG. 18 shows display image 1800 for the initial screen 
which is displayed by the display unit 154 based on the 
transmission data 800 shown in FIGS. 8A to SC. 

As shown in FIG. 18, the display image 1800 has the 
cursor design 1801 corresponding to cursor number "1" 
displayed at a display position (100,600) indicated by the 
display image information 801, in accordance with the hot 
spot information given on line 812 of the link information 
803. It should be noted here that the cursor information 
which represents the selection state has been selected for 
cursor design 1801 in accordance with the initial value of the 
variable Cur-Pos which is held by the control unit 155, 

In the same way, the cursor design 1801 corresponding to 
cursor number "2" is displayed at a display position (100, 
700), in accordance with the hot spot information given on 
line 813 of the link information 803. It should be noted here 
that the cursor information which represents the non- 
selection state has been selected for cursor design 1802 since 
its cursor number "2" does not coincide with the initial value 
of the variable Cur-Fbs. 

Here, since the transmission data 800 includes audio 
information 802 in addition to the display image information 
801, an audio commentary is outputted by the audio output 
unit 157 when the display image 1800 is displayed on the 
display unit 154. 

FIG. 19 shows the display image 1900 which is the initial 
screen displayed by the display unit 154 for the transmission 
data 900 shown in FIGS. 9A and 9B. 

As with the display image 1800 in FIG. 18, the display 
image 1900 has the cursor design 1901 displayed at a display 
position (050,400) indicated by the display image informa- 
tion 901, in accordance with the hot spot information given 
on line 912 of the link information 902. Here, the cursor 
information for the selection state is selected as cursor 
design 1901. 
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FIG. 20 shows the display image 2000 which is the initial 
screen displayed by the display unit 154 for the transmission 
data 1000 shown in FIG. 10A and 10B. 

As before, the display image 2000 has the cursor design 
2001, which corresponds to cursor number "1" and which 5 
shows the selection state, displayed at a display position 
(050,400) indicated by the display image information 1001, 
in accordance with the hot spot information given on line 
1012 of the link information 1002. 

Specific Example of the Procedure of the Control Unit 155 10 

The following is an explanation of a specific example of 
the procedure executed by the control unit 155 when dis- 
playing the display image 1800 on the display unit 154 based 
on the transmission data 800. 

The control unit 155 first sets the initial value of the 15 
variable P-Index at "0001" and the initial value of the 
variable Cur-Pos at "1". Next, the control unit 155 instructs 
the separating unit 151 to obtain the display image infor- 
mation 801 (including the audio information 802) and the 
link information 803 which have the identification number 20 
"0001" set in the variable P-Index. The control unit 155 then 
instructs the reproducing unit 153 to reproduce the display 
image information 801 (including audio information 802) 
stored in the received data holding unit 152. The reproduc- 
ing unit 153 reproduces the display image information 801 25 
and outputs it to the display unit 154 and simultaneously 
reproduces the audio information 802 which it outputs to the 
audio output unit 157. The control unit 155 interprets the 
link information 803 stored in the received data holding unit 
152, generates a cursor design correspondence table, and 30 
outputs design information for each cursor and their display 
positions to the reproducing unit 153. At this point, the 
cursor indicated by the variable Cur-Pos, which is to say the 
first cursor, is displayed in the selection state. 

The control unit 155 then waits for an input from the 35 
signal receiving unit 156. Here, suppose that a "Down" 
signal is inputted into the signal receiving unit 156 from an 
external remote controller. When the input signal is "Down", 
the control unit 155 increases the value of variable Cur-Pos 
by "1**, making it "2". Next, the cursor information for the 40 
selection state is selected as the design for cursor number 
"2" which is indicated by this updated variable Cur-Pos, and 
the cursor information for the non-selection state is selected 
as the design for cursor number "1" which was formerly 
indicated by the variable Cur-Pos, with these sets of cursor 45 
information being outputted to the reproducing unit 153. 

The control unit 155 waits for an interrupt from the signal 
receiving unit 156, with the following explanation describ- 
ing the case when the signal receiving unit 156 stores an 
input signal for a pressing of the "Enter" key after generating 50 
the interrupt. If the input signal is "Enter", the control unit 
155 reads the X-Y coordinates (100,700) corresponding to 
cursor number "2" which is indicated by the variable Cur- 
Pos from the cursor design correspondence table. Next, the 
control unit 155 reads the identification number of the link 55 
destination file of the hot spot information on line 813, based 
on these X-Y coordinates (100,700), and obtains the iden- 
tification number "0003". Next, this identification number 
"0003" is set as the value of the variable P-Index. Following 
this, the control unit 155 instructs the separating unit 151 to 60 
obtain the display image information 1001 and the link 
information 1002 which have the identification number 
indicated by this variable P-Index. The control unit 155 then 
resets the variable Cur-Pos to "1". 

By repeating the processing described above, the display 65 
image 2000 shown in FIG. 20 can be displayed on the 
display unit 154. Here, if an interrupt occurs when the value 
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of the variable Cur-Pos is "1", and an input signal for 
"Enter" is being stored by the signal receiving unit 156 when 
the control unit 155 refers to the signal receiving unit 156, 
the control unit 155 will have the display image 1900 shown 
in FIG. 19 displayed on the display unit 154, as described 
above. 

Procedure for Display Control 

FIG. 21 is a flowchart showing an example procedure for 
display control which is performed by the control unit 155. 

The control unit 155 first sets the initial value of the 
variable P-Index which indicates the identification number 
of the transmission data to be obtained (step 

The control unit 155 then sets the initial value of the 
variable Cur-Pos which indicates the cursor number of the 
cursor in the selection state for the start of display of each 
display screen (step S2102). 

The control unit 155 then instructs the separating unit 151 
to obtain the transmission data which has the identification 
number indicated by the variable P-Index. The separating 
unit 151 then separates the display image information and 
link information in accordance with the indication from the 
control unit 155, and stores the display image information 
and link information with their identification number in the 
received data holding unit 152 (step S2103). 

On being instructed by the control unit 155, the repro- 
ducing unit 153 reproduces the display image information in 
the received data holding unit 152 and outputs it to the 
display unit 154. When there is audio information which is 
related to the display image information, the reproducing 
unit 153 reproduces this audio information and outputs it to 
the audio output unit 157 (S2104). 

The control unit 155 interprets the link information in the 
received data holding unit 152 and outputs the design 
information for the cursor designs together with the X-Y 
coordinates for the display positions of the cursors, as well 
as an instruction to display the design information to the 
reproducing unit 153. The reproducing unit 153 reproduces 
the design information inputted from the control unit 155 
and outputs it to the display unit 154 (step S2105). By doing 
so, one display image is displayed by the display unit 154. 

The control unit 155 waits for an interrupt from the signal 
receiving unit 156 (step S2106), and on receiving an 
interrupt, checks whether the input signal held by the signal 
receiving unit 156 is "Up" (step S2107). 

If the input signal is "Up", the control unit 155 subtracts 
"1" from the value of the variable Cur-Pos (step S2108). If 
not, the control unit 155 checks whether the input signal held 
by the signal receiving unit 156 is "Down" (step S2109). 

If the input signal is "Down", the control unit adds "1" to 
the value of the variable Cur-Pos (step S2110). If not, the 
control unit 155 checks whether the input signal held by the 
signal receiving unit 156 is "Enter" (step S2111) 

If the input signal in "Enter", the control unit 155 uses the 
cursor number shown by the variable Cur-Pos to reference 
the cursor design correspondence table and so finds the 
cursor display position (X 7 Y) whicfT it then uses to find the 
value of the identification number of the link destination file 
in the hot spot information. The control unit 155 then sets 
this identification number as the value of the variable 
P-Index. After this, the processing returns to S2102. 

If the input signal is not "Enter", the processing returns to 
S2106. 

As described above, in the present embodiment the dis- 
play image information, which conventionally would have 
had to have been generated by the data receiving apparatus 
150 while the data receiving apparatus 150 is interpreting 
the control information, is generated and transmitted by the 
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data transmitting apparatus 110, which reduces the load of 
each data receiving apparatus 150. Also, when compared 
with the large number and variety of display control pro- 
cesses for display character strings which were convention- 
ally written into the control information, the link informa- 5 
tion of the present embodiment contains a smaller number 
and less variety of control processes. As a result, simulated 
bidirectional communication can be easily achieved by the 
data receiving apparatuses 150 using this link information. 

The present embodiment describes the case when in order 
to display WWW- home pages on the Internet, the data 
communication system 100 uses a one-to-many TV broad- 
cast to perform simulated bidirectional communication, so 
that when compared to the case when home pages are 
displayed by a browser on a personal computer, the display 
of the user's desired pages on the display unit 154 can be 15 
performed at a high speed which is unaffected by conges- 
tion. Since display image information is sent in a conven- 
tional TV format, the display of full color, high-resolution 
images can easily be achieved by the display unit 154, Also, 
while the display of display images generated by a browser 20 
for display on a TV monitor does not make full use of the 
components, such as the reproduction processing for display 
images, conventionally provided inside a TV, the present 
embodiment can achieve simulated bidirectional communi- 
cation which makes full use of circuitry, such as memory 25 
and decoders, conventionally provided inside a TV set 

In the present embodiment, while the information to be 
obtained has been described as HTML documents which are 
used on the WWW together with compressed image infor- 
mation in GIF format and audio information in AU format, 30 
information expressed in other formats or languages, such as 
HyperCards, can be used. In such case, the processing for 
"<A>" tags refer to a method for conversion for the corre- 
sponding format and language. The present embodiment 
also describes the conversion of an HTML document con- 35 
taining only a limited number of tags, although other HTML 
tags may also be included. 

The present embodiment also describes an example where 
the control for simulated bidirectional communication per- 
formed according to the link information is the switching of 40 
the display to another display image, although other 
processes, such as a process for flashing display on the 
screen, a process for scrolling the display image, or a process 
for activating a device such as a fax, telephone, or video 
recorder connected to the data receiving apparatus, may be 45 
performed in addition to simulated bidirectional communi- 
cation. 

The data communication system 100 is also described as 
having identification numbers of files written into the link 
information by the transmission data generating unit 112, 50 
although this process need not to be performed. As one 
alternative, the original file name may be written into the 
link information as the file identification number. When 
doing so, the file name can be attached to the display image 
information (including audio information) and link informa- 55 
tioa in each set of transmission data during transmission, 
with the data receiving apparatus 150 which receives this 
information successively obtaining a complete set of link 
information after being switched on, so that it can men 
investigate the correspondence between file names and 60 
identification numbers. 

The data receiving apparatus 150 may also store a com- 
plete set of display image information and link information 
which are repeatedly transmitted by the data transmitting 
apparatus 110 in the received data holding unit 152. 65 

When the transport stream shown in FIG. UB is trans- 
mitted from the data transmitting apparatus 110, the receiv- 
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ing apparatus 150 may first have the separating unit 151 
separate and obtain the PMT, before reading the PMT to find 
the PID of the display image information to be obtained and 
having the display image information separated and 
obtained from the transport stream with the read PID as a 
filter condition. It may also read the PID of the private 
stream including the link information from the PMT, and 
then separate and obtain the link information from the 
transport stream with the PID and the identification number 
(table ID extension) as the filter conditions. 

The transport stream shown in FIG. 11B was also 
described as having a video elementary stream made up of 
I pictures, although the video elementary stream may 
include B pictures and P Pictures. The display image infor- 
mation was also described as being encoded according to 
MPEG2 standard, although it may alternatively be encoded 
under another standard, such as MPEG1, JPEG, or GIF. 
Finally, the display image information and audio informa- 
tion were described as being transmitted as a video elemen- 
tary stream and an audio elementary stream, although they 
may be multiplexed as private sections in the same way as 
the link information. 
Second Embodiment 

FIG. 22 shows the construction of the data conversion 
apparatus in the second embodiment of the present invention 
used in a data communication system. Note that the con- 
struction of the data communication system is the same as 
that of the first embodiment. 

The data conversion apparatus includes information 
obtaining unit 2201, data conversion table storing unit 2202, 
cursor design storing unit 2203, temporary document stor- 
age unit 2204, controlling unit 2205, image generating unit 
2206, link information generating unit 2207, and temporary 
information storage unit 2208. 

The data conversion apparatus of the present embodiment 
is equal to information obtaining unit 111 and transmission 
data generating unit 112 of the first embodiment. Informa- 
tion obtaining unit 2201 is connected to an external 
database, and controlling unit 2205 is connected to trans- 
mission data holding unit 1103. 

In the first embodiment, the cursor designs are expressed 
by cursor information which is held inside the control unit 
155 of data receiving apparatus 150. In the second 
embodiment, however, the cursor designs are included in 
image information and transmitted from transmitting unit 
116 of data transmitting apparatus 110. 

Information obtaining unit 2201 obtains multimedia data 
from the external database and stores the obtained data. The 
multimedia data, for example, includes HTML documents 
2301 and 2401 and image 2501 as shown in FIG. 25, where 
image 2501 is compressed under GIF format. 

HTML documents 2301 and 2401 and image 2501 are not 
described here since they have already been described in the 
first embodiment. FIGS. 26 and 27 show HTML document 
2301 and image 2501 displayed by a conventional WWW 
browser on display screen 2601 of a personal computer 
having a resolution of 640x480 dots (pixels). Document 
2301 is displayed as an image over two screens, namely 
consecutive display images 2602 and 2701. The two display 
images can be scrolled in the vertical direction by operating 
on scroll buttons 2603 and 2604 which are respectively 
displayed on the upper-right and lower-right corners of the 
screen. 

Data conversion table storing unit 2202 has a data con- 
version table for converting a multimedia document, which 
has been read from information obtaining unit 2201, into the 
data format suitable for transmission data holding unit 113. 
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The data conversion table includes a tag table (not shown in 
the drawings), font table 2801 as shown in FIG. 28, and link 
information conversion table 2901 as shown in FIG. 29. 

The tag table stores information used for interpreting the 
tags included in HTML document 2361 as shown in FIG. 23, 5 
where HTML documents are written in HTML. The tag table 
has already been described in the first embodiment with 
reference to FIGS. 2 and 4. 

Font table 2801 includes the x-y coordinates of starting 
point 2803 of a character string which corresponds to tag 10 
2802 in HTML document 2301. Font table 2801 also 
includes font size 2804 for the character string. The x-y 
coordinates and font size 2804 are represented by pixels. 

link information conversion table 2901 includes conver- 
sion information 2902 and 2903 for generating the link is 
information. Conversion information 2902 indicates that 
"file name" in HTML document 2301 should be converted 
to "Index file name." 

Conversion information 2903 indicates that tag 
<A>including "file name" as a link destination should be 20 
converted to "Hotspot(M file name)/* where "M" is a 
number corresponding to the number of conversions. 

Cursor design storing unit 2203 stores cursor design table 
3001 as shown in FIG. 30. Cursor design table 3001 includes 
columns for index number 3002 and cursor design 3003. 25 
Index number 3002 is assigned to each of the HTML 
documents linked to an HTML document. In the present 
embodiment, seven HTML documents are linked to HTML 
document 2301. Cursor design 3003 is displayed at the front 
of a hot spot indicating a link destination. The numeral 30 
included in cursor design 303 matches corresponding index 
number 302. 

Temporary document storage unit 2204 stores a document 
among the documents stored in information obtaining unit 
2201 and an image. Temporary document storage unit 2204 35 
stores, for example, HTML document 2301 as shown in 
FIG. 23 and image 2501 as shown in FIG. 25. 

Controlling unit 2205, on receiving from an external unit 
an instruction for generating reproduction information, reads 
a document from information obtaining unit 2201, stores the 40 
document in temporary document storage unit 2204, and 
activates image generating unit 2206 and link information 
generating unit 2207. Controlling unit 2205, on receiving 
from image generating unit 2206 an instruction for writing 
data into transmission data holding unit 113, reads an image 45 
from the image storage area of temporary information 
storage unit 2208, writes the image into display image 
storing unit 123, reads a piece of link information from the 
Hnk information storage area, and writes the piece of link 
information into link information storing unit 125. In this 50 
process, the same identification number is given to both the 
image and the piece of link information so that both are 
identified as a pair. 

Controlling unit 2205, on receiving an instruction for 
storing an image specified by image generating unit 2206 55 
into temporary document storage unit 2204, reads the speci- 
fied image and stores the image into temporary document 
storage unit 2204. 

Image generating unit 2206, when activated by control- 
ling unit 2205, allocates an image storage area in temporary 60 
information storage unit 2208 for storing an image with the 
size of a screen, then allocates a link information storage 
area related to this image storage area. 

Image generating unit 2206, after allocating the image 
storage area in temporary information storage unit 2208, 65 
reads a tag table (not shown in the drawings) and font table 
2801 from data conversion table storing unit 2202, and 



30 

converts character strings and images of the document 
stored in temporary document storage unit 2204 into an 
image to be displayed. The process of the conversion has 
been described in the first embodiment in relation to trans- 
mission data generating unit 112. 

Image generating unit 2206, on reading tag <IMG>2304, 
instructs controlling unit 2205 to fetch image file "Weath- 
er.gif ' into temporary document storage unit 2204. 

Image generating unit 2206, on reading tag <A>2305, 
notifies link information generating unit 2207 of the file 
name as a link destination. Image generating unit 2206, on 
receiving an "M" value from link information generating 
unit 2207, obtains a cursor design 3003 corresponding to the 
"M" value (index number) by referring to cursor design 
table 3001. Image generating unit 2206 then calculates 
coordinate values (Xst,Yst) of a display position of the 
display element (character string or image) of the HTML 
document, which is also used as a cursor position. The 
coordinate values (Xst,Yst) indicate a point at the upper-left 
corner of the display element block. Value Xst is determined 
as "10" from x-10 included in font table 2801, "X" indi- 
cating the starting position of tag <L1>. Value Yst is 
obtained by adding up the number of pixels in Y-coordinate 
direction before the tag <A>. 

For character string "OSAKA" included in tag <A>2305 
as shown in FIG. 23, Xst-0 and Yst-10+80+(270)+ 60-420, 
where the numeral in parentheses "( ) H indicates the number 
of pixels in Y-coordinate direction of image file "Weatfa- 
er.gif" as a display image. Note that the image file "Weatb- 
er.gif as a display image is 360x270 pixels in size. 
Accordingly, coordinate values (Xst,Yst) are calculated as 
(10,420). 

Image generating unit 2206 writes the obtained cursor 
design 3003 at the start of (Xst,Yst) in the image storage area 
in temporary information storage unit 2208, then writes a 
character string after the cursor design. FIG. 31 shows image 
information 3102 which is generated from HTML document 
2301 as shown in FIG. 23 and is stored in image storage area 
3101. 

Image generating unit 2206, when image information 
3102 is written into image storage area 3101, newly assigns 
only image storage area 3201 (see FIG. 32) in temporary 
information storage unit 2208. Image generating unit 2206 
then analyzes HTML document 2301 and writes the image 
into image storage area 2301. Image generating unit 2206, 
on recognizing that HTML document 2301 has been 
analyzed, instructs controlling unit 2205 to write data into 
transmission data holding unit 113. 

Link information generating unit 2207, when activated by 
controlling unit 2205, reads a file name of a file stored in 
temporary document storage unit 2204, such as 
"Report.html/* by referring to link information conversion 
table 2901 of data conversion table storing unit 2202. 

Link information generating unit 2207 sets counter M, 
which is used as index number 3002, to 44 1" when "file 
name" is converted into "index(file name).** Link informa- 
tion generating unit 2207, on receiving the contents of tag 
<A>2305 from image generating unit 2206, sends the value 
of counter M to image generating unit 2206, generates a 
piece of link inform ation according to conversion informa- 
tion 2903 in link information conversion table 2901, stores 
the generated piece of link information in the link informa- 
tion storage area in temporary information storage unit 
2208, and increments the value of counter M. After this, the 
value of counter M, or index number 3002, is inserted at the 
front of the file name in the piece of link information. 

Temporary information storage unit 2208 temporarily 
stores the image generated by image generating unit 2206 
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and the piece of link information generated by link infor- 
mation generating unit 2207. FIGS. 31 and 32 show images 
3101 and 3102 generated from HTML document 2301 as 
shown in FIG. 23. FIG. 33 shows link information 3301 
which commonly corresponds to images 3102 and 3202. 

How, the operation of the present embodiment is 
described with reference to the flowchart of FIG. 34. 

When controlling unit 2205 receives an instruction for 
generating an image from an external element, image gen- 
erating unit 2206 allocates an image storage area and a link 
information storage area in temporary information storage 
unit 2208 for storing an image with the size of a screen 
(S3402). 

Image generating unit 2206 then judges whether an 
unanalyzed HTML document is stored in temporary docu- 
ment storage unit 2204 (S3404). If stored, image generating 
unit 2206 analyzes the HTML document (S3406); if not, 
controlling unit 2205 reads image information and link 
information from temporary information storage unit 2208, 
writes them into transmission data holding unit 113 as a pair, 
and ends processing. 

Image generating unit 2206 judges whether the analyzed 
HTML document is link information (control information 
including tag <A>) (S3408). If it is, image generating unit 
2206 obtains a certain cursor design from cursor design 
storing unit 2203 (S3410); if not, control goes to S3412. At 
S3412, image generating unit 2206 calculates a display 
position of the display element in the HTML document 
(S3412), and places the display element at the display 
position. If it is judged that the HTML document is link 
information at S3408, image generating unit 2206 inserts the 
cursor design at the display position before the display 
element, and link information generating unit 2207 writes 
link information into the link information storage area 
(S3414). Image generating unit 2206 judges whether the 
image storage area has a space for storing another display 
element (S3416). If it has, control returns to S3401; if it does 
not, image generating unit 2206 assigns only the image 
storage area in temporary information storage unit 2208 
(S3418), and control returns to S3404. 
Third Embodiment 

FIG. 35 shows the construction of the data conversion 
apparatus in the third embodiment of the present invention 
used in a data communication system. The data conversion 
apparatus includes information obtaining unit 2201, data 
conversion table storing unit 2202, cursor design storing unit 
2203, apparatus information storing unit 3501, temporary 
document storage unit 2204, controlling unit 2205, image 
generating unit 3502, link information generating unit 3503, 
and temporary information storage unit 2208. Of these, the 
same elements as those of the second embodiment are not 
described here. The following is a description of the ele- 
ments unique to the third embodiment. 

FIG. 36 shows remote controller 3601 for transmitting 
signals to signal receiving unit 156, which has been 
described in the first embodiment. Remote controller 3601 
includes 12 numeral buttons. Of these, six buttons "1" to "6" 
are used for specifying a cursor design. 

Apparatus information storing unit 3501 stores "k," which 
represents the maximum number of cursor designs that can 
be displayed in one screen, where the cursor designs are 
used to identify link destination files. In the present 
embodiment, k is "6" since six buttons are used for speci- 
fying the cursor designs. 

Controlling unit 2205 notifies image generating unit 3502 
and link information generating unit 3503 of a completion of 
writing when controlling unit 2205 has written an image and 
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a piece of link information into display image information 
storing unit 123 and Slink information storing unit 125 
respectively. Controlling unit 2205 also includes the func- 
tions described in the second embodiment. 

5 Image generating unit 3502 recognizes the number of tags 
<A>in HTML document 2301 from the value of counter M 
sent from link information generating unit 3503. Image 
generating unit 3502 also includes the functions of image 
generating unit 2206 described in the second embodiment. 

10 FIG. 37 shows image 3701 which is obtained by converting 
image file "Weather.gif » in HTML document 2301 into a 
display image, image 3701 being 360x210 pixels in size. 
Image generating unit 3502, after generating an image for 
one screen, instructs controlling unit 2205 to write the image 

15 into transmission data holding unit 113. 

Image generating unit 3502 judges whether the value of 
counter M, which is sent from link information generating 
unit 3503, matches the value of k in apparatus information 
storing unit 3501. When they match, image generating unit 

20 3502 writes the corresponding cursor design and the display 
element into temporary information storage unit 2208, then 
instructs controlling unit 2205 to write the cursor design and 
the display element into transmission data holding unit 113. 
In this way, image 3801 as shown in FIG. 38 is generated, 

25 where the number of pieces of link information does not 
exceed k in apparatus information storing unit 3501. 

FIG. 39 shows image 3901 which is generated by con- 
verting the display element in HTML document 2301 into a 
display image. 

30 Link information generating unit 3503 includes the func- 
tions of link information generating unit 2207 described in 
the second embodiment. Link information generating unit 
3503 also includes following functions unique to the present 
embodiment. Link information generating unit 3503, on 

35 being activated by controlling unit 2205, sets counter N to 
"0 " Link information generating unit 3503, on receiving a 
notification of a completion of writing from controlling unit 
2205, adds "1" to counter N. When counter N has a value 
other than "0," link information generating unit 3503 

40 changes the link information to "Index ("ReportN.htm"). w 
Link information generating unit 3503 sets counter M to "l w 
when fink information generating unit 3503 sets counter N 
to "0," then increments the value of counter M every time 
the value of counter N is incremented. 

45 In the above-described process, pairs of image 3701 and 
link information 3702, image 3801 and link information 
3802, and image 3901 and link information 3902 are gen- 
erated. 

Suppose channel 12, among a plurality of broadcasting 

50 channels received by display unit 154, is assigned to an 
Internet broadcasting, and that the button " 12" on the remote 
controller specifies channel 12. When signal receiving unit 
156 receives the signal of button "12" from the remote 
controller during a reproduction of a general TV broadcast- 

55 ing channel, image 3701 as shown in FIG. 37 is read from 
temporary information storage unit 2208 and is displayed on 
display unit 154. Here, if button "1" is pressed on the remote 
controller, hot spot 1 OSAKA is selected, and the screen 
displays the image of HTML document "Osaka.html" 240L 

60 To return to the general TV broadcasting channel, button CH 
3604, then, one buttons "1" to "11" is pressed. 

Now, the operation unique to the third embodiment is 
described with reference to the flowchart as shown in FIG. 
40. Image generating unit 3502 assigns an image storage 

65 area and a link information storage area in temporary 
information storage unit 2208 to a display image (S4002). It 
is judged whether temporary document storage unit 2204 



